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ABSTRACT 

This  paper  deals  with  machine  perception  of  flat  surfaces.  For  an  observer  that 
undergoes  only  translational  motion  in  parallel  to  a planar  surface,  we  show  that  a non- 
linear function  of  optical  flow  produces  the  same  value  for  all  points  on  this  surface, 
i.e.,  there  is  an  optical-flow  based  invariant  for  all  points  that  lie  on  a flat  surface.  We 
discuss  some  potential  uses  of  this  invariant. 
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1.  INTRODUCTION 


The  problem  of  constant  perception  despite  varying  visual  sensations,  i.e.,  how 
despite  different  images  of  the  same  scene,  the  world  is  perceived  as  stationary,  has 
puzzled  many  researchers  in  the  last  five  decades  (see  for  example  [1]).  In  an  attempt 
to  answer  this  question  another  basic  question  arises:  Is  there  an  image- sequence 
transformation  under  which  permanent  properties  of  the  environment  are  preserved  dur- 
ing the  motion  of  the  eye?  [1,6,7] 

This  paper  deals  with  machine  perception  of  flat  surfaces.  For  an  observer  that 
undergoes  only  translational  motion  in  parallel  to  a planar  surface,  we  show  that  a non- 
linear function  of  optical  flow  produces  the  same  value  for  all  points  on  this  surface, 

1. e.,  there  is  an  optical-flow  based  invariant  for  all  points  that  lie  on  a flat  surface. 

2.  A FLAT  SURFACE  INVARIANT 


The  optical  flow  generated  by  a point  in  3-D  space  as  expressed  in  spherical  coor- 
dinates is  (See  Appendix  and  [2-5]): 
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Refer  to  Figure  1.  Assume  that  the  Z axis  of  the  camera  is  perpendicular  to  the 
flat  surface.  For  the  case  where  the  camera  undergoes  translation  only  along  its  optical 
axis  (the  Y axis)  i.e.,  a=B=C=U=W=Q,  Equation  (1)  becomes: 
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For  the  restricted  translational  motion  of  the  camera  as  mentioned  above,  the  fol- 
lowing geometrical  relationship  holds  for  all  points  on  the  flat  surface: 
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By  combining  Equations  (2)  and  (3)  we  obtain: 
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From  the  last  equation  we  obtain: 
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In  Equation  (5)  V and  Z are  constant  for  all  points  on  the  flat  surface,  and  thus 

^ — - and  — are  constant  for  all  points  on  the  flat  surface  (they  are  also 
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equal  to  each  other).  This  also  means  that  any  point  on  the  flat  surface  produces  the 
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same  values  of  some  functions  of  optical  flow  which  are,  in  our  case, and 

tan(t)cos0 

— . The  value  obtained  from  these  optical-flow-based  functions  is  invariant 
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under  the  given  motion. 

3.  DISCUSSION 


In  this  short  paper  we  presented  an  optical-flow-based  invariant  of  a flat  surface 
for  translational  motion  of  a camera.  The  approach  is  a step  toward  the  understanding 
of  perception  of  3-D  rigid  bodies. 

This  invariant  can  be  used  to  build  topographic  maps  from  a camera  that  under- 
goes translation  above  a terrain,  since  for  a horizontally  translating  camera  each  height 
above  a certain  reference  level  corresponds  to  a value  of  the  optical-flow-based 
previously-described  functions.  This  invariant  can  also  be  used  to  detect  obstacles  on  a 
flat  road  using  an  on-board  camera,  since  all  points  on  the  road  will  generate  the  same 
value  of  the  previously  expressed  functions  and  any  point  above  or  below  the  road  sur- 
face will  produce  a different  value. 
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In  this  paper  the  invariant  is  derived  for  a special  motion  of  the  camera,  where  it 
undergoes  translation  only  along  its  optical  axis  (the  Y axis)  and  the  Z axis  of  the  cam- 
era is  perpendicular  to  the  flat  surface.  However,  by  reorienting  the  camera  and  apply- 
ing appropriate  calibration,  a less  restricted  result  can  be  obtained. 

We  are  currently  working  on  invariants  for  more  general  camera  motion  (in  partic- 
ular motions  that  involve  fixation)  and  arbitrary  shape  objects. 
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APPENDIX:  EQUATIONS  OF  MOTION  AND  OPTICAL  FLOW 

This  appendix  describes  the  equations  that  relate  a point  in  3-D  space  to  the  pro- 
jection of  that  point  in  the  image  for  general  six-degree-of-freedom  motion  of  the  cam- 
era. 

In  the  following  analysis,  we  assume  a moving  camera  in  a stationary  environ- 
ment. Suppose  the  coordinate  system  is  fixed  with  respect  to  the  camera  as  shown  in 
Figure  Al.  Assume  a pinhole  camera  model  and  that  the  pinhole  point  of  the  camera  is 
at  the  origin  of  the  coordinate  system.  We  derive  the  optical  flow  components  in  the 
spherical  coordinates  (/?-e-<t)).  In  this  frame,  angular  velocities  (0  and  of  any  point  in 
space,  say  P,  are  identical  to  the  optical  flow  values  at  P’  in  the  image  domain.  Figure 
A2  illustrates  this  concept:  0 and  (j)  of  a point  in  space  are  the  same  as  0 and  ^ of  the 
projected  point  P’  in  the  image  domain,  and  therefore  there  is  no  need  to  convert  angu- 
lar velocities  of  points  in  3-D  space  to  optical  flow.  In  Figure  A2  the  image  domain  is 
a sphere.  However,  for  practical  purposes  the  surface  of  the  image  sphere  can  be 
mapped  onto  an  image  plane  (or  other  surface). 

We  start  with  the  derivation  of  the  velocity  of  a 3-D  point  in  the  XYZ  coordinates 
(Figure  Al).  Let  the  instantaneous  coordinates  of  the  point  P be  R = (where 

the  superscript  T denotes  transpose).  If  the  instantaneous  translational  velocity  of  the 
camera  is  i = {uy,wf  and  the  instantaneous  angular  velocity  is  = then  the 

velocity  vector  V of  the  point  P with  respect  to  the  XYZ  coordinate  system  is: 


V = -t-<oxR  (Al) 

or: 

Vx  = -U-BZ+CY  (A2) 

Vy  = -V-CX+AZ  (A3) 

Vz  = -W-AY+BX  (A4) 


where  Vx,  Vy,  and  Vz  are  the  components  of  the  velocity  vector  V along  the  X,  Y,  and  Z 
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directions  respectively. 


To  convert  from  RQ<^  to  XYZ  coordinates  we  use  the  relations: 


X = R cos(|)  COS0 

(A5) 
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(A7) 

Similarily,  to  convert  from  XYZ  to  R 0<J)  coordinates  we  use: 
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In  order  to  find  the  optical  flow  of  a 3-D  point  in  RQ^  coordinates,  we  use  the  follow- 

ing  relations  and  transformations: 

Let  Vft , Vq,  and  be  the  components  of  the  vector  V in 

spherical  coordinates,  and 
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Then: 
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where  dot  denotes  first  derivative  with  respect  to  time. 

Using  equations  (A2)-(A18)  yields  the  following  expressions: 
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As  mentioned  earlier,  0 and  (j)  of  a point  in  space  (i.e.,  the  angular  velocities  in  the 
camera  coordinate  system)  are  the  same  as  the  optical  flow  components  0 and  (}>  (Figure 
A2). 
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Figure  1;  Camera  Coordinate  System  Relative  To  The  Flat  Surface 
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Figure  Al:  Camera  Coordinate  Systems 
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Figure  A2;  Image  Domain 
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